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ABSTRACT 

Since Students in Freshman English face the problem 
of feeling that they cannot begin to match the professional writers 
whose essays they read, an experiment was designed in which 
instructors used well-written themes of fellow students as examples 
of good writing on a level r,ore attainable than the professional 
essayist. Pairs of themes--one well written, one poorly written — were 
read, discussed, and compared by students in the experimental group 
before actually writinq a specific rhetorical assignment, while the 
control group was taught by the instructor’s conventional method. 
Themes of both experimental and control classes were judged according 
to a "Behavioral Objective” (for thesis statement, organizational 
outline, theme body, introduction, and conclusion) agreed upon by the 
Project Director and colleagues as "writing.” Results were twofold: 

(1) the comparative method seemed to be effective in the teaching of 
some kinds of themes (e.g., definition, comparison-contrast, 
diagnostic themes) and ineffective in others (e.g., illustration 
themes) ; and (2) the Behavioral Objective used to measure and 
evaluate both sets of themes proved to be the greatest contribution 
of the project. Five graphs included in this report may be illegible 
in hard copy reproduction* (JMC) 
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SUMMARY 



Students in Freshman English face the problem of feeling that the/ cannot 
begin to match the professional writers whose essays they read. There is 
i- definite need, then, for instructors to use themes written by fellow students 
so that a student whose assignment is to write a particular form of rhetoric may 
examine samples of good writing on a more attainable level, than the pro- 
fessional essayist. Because it was felt that if they saw themes written by 
fellow students, including poor themes as well as good ones, they would have 
a better understanding of a certain rhetorical assignment, on experiment was 
conducted to evaluate a comparative method of teaching. The method consisted 
of a pair of themes for several kinds of rhetoric in which a poor theme and a 
well -written theme were read end discussed by students in the experimental 
group before actually writing that specific rhetorical assignment. (The control 
group was taught by the instructor^ conventional method. ) In order to evaluate 
themes written by both experimental and control classes, a Behavioral Objective 
for grading themes was devised. The Objective was a specification or definition 
of what the Project Director and colleagues agreed upon as "writing" in English 
Composition I. (See Appendix A) 

The results of the experiment were twofold: (1) The comparative method seems to 
be effective in the teaching of some kinds of themes ond ineffective in others; 

(2) As was anticipated, the greatest contribution of the project was the effective** 
ness of the behavioral objective used to measure and to evaluate the themes ?;om 
experimental and control classes. An exceptionally high coefficient of 
correlation was determined — .782 at the .01 level when the scores of the two 
graders were compared. During the semester in which material was tested, two 
major problems were seen: one problem was attendance in classes during campus 
unrest at 'ho latter part of the semester, and the other was the lack of uniformity 
in using the experimental material and in making assignments in one of the 
instructor's classes. Despite these two problems which may have been a limiting 
factor in gathering data, the experiment was completed; furthermore, there seems 
to be evidence gained from the experiment which suggests the need for further 
evafuation of both the Behavioral Objective used in grading and the comparative 
method of teaching rhetoric used in Freshman Composition. 



INTRODUCTION 



Because of the growing emphasis on how to "motivate" the student to write 
on something; which incorporates interesting, colorful, ond original material 
rather than on rhetoric, there seems to be c definite lack of instruction in 
form and organization at present in the area of Freshman Composition. 

Many of the freshman English texts inclucfe rhetorical categories, yet in the 
teaching field itself, the emphasis still remains on "motivation". One con 
see how rhetoric in the beginning semesters of college English could become 
confusing to the student if he is urged to use forms of rhetoric, such as 
definition, illustration and comparison -contrast, ond yet is given no instructional 
samples other than of professional essayists. The main difficulty that students 
have in using rhetorical forms is that they feel they cannot begin to match the 
professional writers whose essays they read; students need to be able to examine 
sample themes written by fellow students. Many institutions ao have student 
handbooks containing sample themes, but it is unusual to find those with 
emphGsis on the kinds of rhetoric used in freshman English. It was felt that 
perhaps if students could examine and discuss' themes which dealt with specific 
kinds of rhetoric, one which exemplified poorly written as well as good themes, 
the first semester student could discover more graphically how rhetorical form 
can be achieved as well as how organization and development make competent 
writing. 

In order to present both poorly-written and well -written themes to a class of 
students for instructional va'uo, a comparative method of teaching composition 
was devised. As a guideline for choosing the themes to be used, consideration 
was given to clearly establishing whot is meant by "writing' 1 . In this instance, 
writing did not mean paying attention to mechanical difficulties which stand 
out, while allowing irrelevant arguments or bland generalizations to go unnoticed. 
Sample themes were chosen for their ability to recognize a subject and it* 
boundaries, to order and support the central idea dealing with the subject, to 
conduct the argument with quality rather than quantity, and to show a "feel" 
(ability to use words as a vehicle of thought and feelings and to choose novel 
ideas as well as control the language) for words. Whereas, the san.ple themes 
were required to show competence in writing, they were also required to exemplify 
one specific form of rhetoric, such as definition, illustration, comparison-ccntrost, 
or cause-effect. After the sample themes in the well -developed category wero 
chosen, their poorly -written counterparts in the some rhetorical form and central 
idea were chosen to complete a matched pair of themes on the same topic with 
varying degrees of value. 

In order to assemble and classify a collection of comparative themes, dozens of 
student papers were re-read to find papers which demonstrated a poorly -developed 
approach on o certain topic to contrast with a well -developed approach on the 
identical topic with the identical form of rhetoric. Categories for the kinds of 
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rhetoric used were: (1) Definition; (2) Comparison -Contrast; (3) 1 1 lustration— 
Cxnmple; (4) Cause -Effect ; (5) Symbolism. In the experimental class, each 
pair of themes were presented to the students to read in order to have a class 
discussion on which was the better theme and why and which wos the poor theme 
and what was locking. By examining and discussing the pairs o f themes, it was 
hoped that the students would become more selective in their ability to develop 
a theme with competence in writing. 

To carry out this experiment, a behavioral ob[ective was devised to define 
operationally what one means by "writing" in freshman composition. After con- 
sultation and evaluation by discussion with other instructors and interested parties, 
the operational definition was applied in a few instances of writing and then 
was restated offer further meetings and discussions of a points system and refine- 
ment of the operational definition. (See Appendix A) Because Dubln and Traveggia, 
in their book called Teaching -Learning Paradox, seem to feel that emphasis on 
comparative studies is no longer^ruitfuf, Tt^/as felt even before the experiment 
was conducted that the comparative method might not prove to b> the most out- 
standing point, but that the most significant contribution to come out of the 
comparative teaching method might be the operationally defined statement of a 
freshmen theme. The results of the experiment seem to indicate that this supposition 
was indeed true. 

Because early in the Semester it could be determined that a special problem of 
teacher bias was arising out of the effort to avoid bio.', the plan to have one 
Instructor introduce the comparative theme materials to the experimental class 
rather than the Project Director was changed to include a second instructor and 
an entirely separate set of classes. Apparently, the first instructor did not always 
have an opportunity to study the comparative theme material adequately to gain 
full instructional possibilities; therefore, an odditionol pair of classes (one control 
and me experimental) was added to the research project. A second assistant 
professor agreed to use two English Composition \l closses so that the teaching 
method could be research *d in a second experiment which included three sets of 
composition themes. 

METHODS 



Presentation of the Experimental Material 

After the experimental material was presented to the respective classes, the themes 
from both the experimental and the control classes were graded by two assistant 
professors who served as graders for the experiment. The Project Director kept a 
record of each pair of classes and the scores for each individual student. Within 
the total points of each individual theme, the scores wc-re also kept for each of 
the sections into which the theme was divided. For exomple, the student wos 
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allowed a total of 90 points per theme, and within that point he could 
acquire points as follows: 



(1) The Thesis Statement 

(2) Organization 

(3) The Body Development 

(4) The Introduction 

(5) The Conclusion 



Worth 15 points 
Worth 15 points 
Worth 30 points 
Worth 15 points 
Worth 15 points 



Although the total number of points possible for a theme is 90 points, the 
total number of points is then converted to a grade number of one to fifteen. 

The theme grade, then, can be from one to fifteen. The conversion scale 
method was suggested by Mr. Irving Gersten, the instructor using the com*' 
parative theme project material in the experimental class, who had used th’s 
method when grading with a group evaluating Graduate Record Exam themes. 

The conversion scale is used to help eliminate teacher bias between graders. 

(See Appendix A for an example of the scale.) 

If a student ware to obtain seven (7) points for each of those five categories, 
his score would be 35 total points. His grade would then be converted to a 
scale which ranges from one to fifteen points, with fifteen being the highest 
possible grade. Sample illustrations of score sheets are included in Appendix B. 



Findings and Analysis 



After computation of grodes from experimental and control classes, the findings 
are as follows: 



1 . In the use of the point system between the two graders, the overall 
coefficient of correlation is significantly high. The significant r 
indicates there is a high degree of agreement in use of and in interpre- 
tation of the behavioral objective between the two graders. It was found 
that r =■ .743 at the p<.01 level. 

When the two graders were compared within the sections in the total 
grade points, It was found that r varied slightly . For example, in the 
sets of themes on Symbolism in Gies 1 closs, r = .725, whereas on her 
Comparison -Contrast themes, r= .562. 

2. Findings * Gersfen's Classes with Four Sets of Themes (Diagnostic, 

Compa r» son -Contra $t , Definition and Illustration] ~ 

o. There was no significant difference ( p> *05) in the Ohio 

Psychological Scores between the two classes. (S'J9 Appendix 
C for O.P. Scores.) 
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b. In Thome I, the Diagnostic theme, there was no significant 
difference ot the ,01 level. However, there was a 
significant difference at the .05 level in favor of experimental 
class. Since in the diagnostic themes no experimental material 
was used, there would need to be a significant difference at a 
higher (.01) level in future matched themes in order to show 
ony definite improvement. 

By breaking down Theme I into the theme sections of organization 
and envelopment, it was found that there was no difference at 
either level in development (combined Sections 3, 4 and 5), 
yet there was organization (1 and 2) at the .05 level (t = 2.6275) 
but not at the .01 level. This score suggests that the experimental 
group was slightly higher in ability to organize than the control 
class at the beginning of the project. 

c. In Theme II, Comparison-Contrast Theme, the statistics came oJt 
similar to those in Theme I; i.e., in total matched students there 
was a significant difference at the .05 level (but not at .01) in 
favor of the experimental group. 

However, when comparing the matched students onl^, there was 
also a significant difference at the .01 level inTavor of the 
experimental class. 

By breaking down theme sections, it was found that the difference 
in Theme II, however, was in favor of the experimental group in 
the development section rather than organization. This score 
could possibly suggest a slight improvement in the development 
section in experimental groups c* well as in organization in 
control groups. 

d. In Theme HI, Definition Theme, there • as a significant change in 
favor of the experimental group. It was found that the experimental 
group showed a significant difference ot the .01 lovel. This score 
shows there is o difference between these two methods. By breaking 
down the theme sections, it was found that there was a significant 
difference at the .01 level In both organization and development 

in favor of the experimental group. (In organization t « 3.95; 
in development t = 3.913). The experimental group improved 
significantly in both organ*, otior jod development of the Definition 
Theme when given the comparative theme material. 

e. In Theme IV, the instructor failed to assign the some amount of time 
to both classes; i.e,, one class wrote an outside theme ond the 
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other class an m~class theme • Therefore, Theme IV scores 
were not included in the statistical analysis. (For comparative 
theme material, see Appendix D) 

f. In Theme V/ Illustration Theme, there was no significant 
difference at either level for the experimental group. This score 
suggests that the comparative theme material used in the 
experimental group was not significantly better than the instructor’s 
conventional method. 

g. In the total, overall comparison of scores, it was found that 

t = 1.6554 with a df of 137. Therefore, there is no significant 
difference in the overall view of the comparative theme material, 
it is in the individual theme comparison that a difference can be 
determined. It must be concluded, then, that the comparative 
theme method can be effective in certain kinds of themes , 
particularly definition {see Section IV of Report, Graphs of 
individual student., 1 progress in sections of themes), but that since 
there is r.o overall significant difference in the means between the 
two methods of instruction, the experimental and conventional 
methods in general are equivalent. For a complete chart on 
Mr. Gersten's classes, see Section IV, Chart * 1 . 

Findings - Gies* Classes (Diagnostic, Symbolism and Comparison of 

Imagery in Two Poems) 

a. In the comparison of Ohio Psychological Scores between the two 
classes, there was no significant difference. p>.05 (See Appendix 
C for chart). 

b. In the three pairs of themes assigned, there was no indication in 
favor of the comparative theme method administered to the 
experimental class. In Theme I, Diagnostic Theme, p>.05. 

In Theme II, Symbolism, there was o significant difference, p^.Ol 
when comparing means between classes of unmatched students. 

(With a df of 43, t = 3.6115 in favor of control of unmatched 
students.) One interesting point, however, is that when com- 
paring means between the classes ?n which matched students only 
were considered, there was no significant difference: p^.65. 

By brooking down the theme into sections of organization ( 1 and 2) 
development (3, 4, and 5), it was determined that although section 
1 and 2 on organization had no significant difference, in section 



